Augmented reality on wireless mobile devices

ABSTRACT

An augmented reality control system in which the generation and utilization of simple geometric forms of real world objects at the enterprise level are layered onto or based on real world objects. Digital data is aligned to real world objects via surrogate of simplified geometric forms.

CROSS REFERENCE TO RELATED APPLICATIONS

The present invention claims priority to U.S. Provisional ApplicationNo. 61/717,788, entitled “Augmented Reality Control Systems” and filedon 24 Oct. 2012, the disclosure of which is incorporated herein byreference in its entirety.

FIELD OF THE INVENTION

The present invention relates to relates to a process of capturing andrendering data on a mobile device and, in particular, an augmentedreality system that registers external information with real objects.

BACKGROUND OF THE INVENTION

Augmented Reality (AR) enhances a user's perception of, and interactionwith, the real world. Virtual objects are used to display informationutilized to perform real-world tasks. When based on an optical approach,a user directly sees the real world through optics, with graphicscombined within the user's field of view. Spatially and temporallycorrect display of digital information on real world objects, however,is difficult to achieve on mobile AR devices. It would be desirable tohave system that is device independent (phone, head mounted display,etc.), and that provides transport efficient (minimized data sets toaddress growing mobile network bandwidth issues along with high speeddownload) and process-bandwidth-efficient (simplified processing tomaintain mobile device battery life and to provide low latency)geo-spatial registration of digital data onto real world objects.

SUMMARY OF THE INVENTION

The present invention is directed toward an augmented reality controlsystem including a mobile device that communicates with an enterprisesystem and via a wireless network. The enterprise system generates awireframe model or other simplified representation of real world objects(i.e. surface models) designed to register digital content with the realworld. In operation, the mobile device communicates with the enterprisesystem to provide location and directional information that, in turn, isutilized by the enterprise system to identify a corresponding wireframemodel and send it to the mobile device. The use of the above wireframeprocess enables data sets with smaller bandwidth requirements for theirprocessing, transmission, and reception. This, in turn, minimizeslatency in the device, as well as lessens power requirements of thedevice. In addition, simple data sets facilitate locking the coordinatesystems together, making for better spatial correctness.

Specifically, the enterprise system generates a wireframe model or othersimplified representation of real world objects (i.e. surface models)designed to register digital content with the real world. In thewireframe model, geographic image sources are assigned coordinate pointsto key data set features, i.e., every endpoint of lines of wireframewhere the coordinates are based on GPS location information. Forexample, the edges of a building include distinct coordinate values, asdoes the edges of a street. The enterprise system extracts thesecoordinate values from the image sources to generate a wireframerepresentation of the world. Stated another way, the enterprise systemcreates a simplified geometry of the real world objects (syntheticgeometry) from sources other than the mobile device. For example, LiDARdata from aircraft or video imagery from aircraft is used as the sourcefor the geometry set. This wireframe representation is a mathematicallyefficient geo target set.

In operation, the mobile device communicates with the enterprise systemto provide location and directional information that, in turn, isutilized by the enterprise system to identify a corresponding wireframemodel and send it to the mobile device. Specifically, the camera on themobile device captures the scene being viewed by a wearer. Software onthe mobile device performs an edge extraction routine (or other geometrymatching) on the captured imagery, identifying edges or key points ofthe object being viewed. This extracted edge data is transmitted to theenterprise system, along with the user's location information (obtainedvia the device's GPS or IMU) and nominal direction information (obtainedvia the compass).

At the server, the extracted edge data, along with the user's locationand nominal directional information, correlate the extracted edges tothe wireframe model based on the nominal direction. Alternatively, thecorrelation may be accomplished on the mobile device. When correlated,the camera view is linked to the digital coordinate system, registeringthe user's view with wireframe model. Digital data is then superimposedonto the user's field of view via the display system. The user mayselect from the displayed data, pulling further information from theweb.

The use of the wireframe process enables data sets with smallerbandwidth requirements for their processing, transmission, andreception. This, in turn, minimizes latency in the device, as well aslessens power requirements of the device. In addition, simple data setsfacilitate locking the coordinate systems together, making for betterspatial correctness.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a schematic view of an augmented reality system forexecuting a geo-registration process in accordance with an embodiment ofthe present invention.

FIG. 2A illustrates a synthetic geometry model in accordance with anembodiment of the invention.

FIGS. 2B and 2C illustrate digital information (data layers) that may beassociated with the synthetic geometry model in accordance with anembodiment of the invention.

FIG. 2D illustrates the synthetic geometry model of FIG. 2A associatedwith the digital data of FIG. 2C.

FIG. 3 illustrates a mobile device in accordance with an embodiment ofthe invention.

FIGS. 4A and 4B illustrate an on-device registration process for anaugmented reality system in accordance with an embodiment of theinvention.

FIGS. 5A, 5B, and 5C illustrate an off-device process flow for anaugmented reality system in accordance with an embodiment of theinvention.

Like reference numerals have been used to identify like elementsthroughout this disclosure.

DETAILED DESCRIPTION OF THE INVENTION

Referring to FIG. 1, the augmented reality system 100 includes anenterprise system 105 and a mobile device 115 that communicates via awireless network. The enterprise system 105 (also called a syntheticgeometry or geo-registration server) generates and hosts the geometry ormodel, with the geometry being created outside of the system 105. Thissynthetic geometry may exist in several different forms, and may behosted on the same system, with software access to any or all of theforms. The generation of the synthetic geometry may be accomplishedusing real world data or entirely synthesized data (i.e. 3D models) or acombination of the two. Specifically, synthetic geometry may beinitially created from external, real world data via, e.g., syntheticaperture radar (SAR) or light detection and ranging (LIDAR). By way ofexample, LIDAR point clouds may be processed into surface geometry, orwireframes or two-dimensional imagery may be processed to create surfaceor texture models.

The synthetic geometry 200 may include one or more layers or models ofincreasing complexity and/or detail. Referring to FIG. 2, showing ageometry configuration in accordance with and embodiment of theinvention, the synthetic geometry 200 includes as its nominal base forma wire frame representation or model 210. Additional layers, moreover,may be set for various detail levels. As shown, the higher levels mayinclude surface models 220, texture models 230, and imagery-based models240. The imagery based model or layer 240 may take in imagery from anumber of sources and, moreover, may contain geo-location coordinates.These models 210-240 may be used in a layer-like context, with moredetailed layers on top of simpler (less detailed) layers, resulting intransport efficiency that increases from the top (imagery) layer towardthe bottom (wireframe) layer. In the illustrated embodiment, while thesimplest geometric representations is a wireframe model, it should beunderstood that the layers may be further simplified to a smaller groupof lines or even reference points that can have their real worldversions extracted from video imagery. In addition, the model maycontain any number of models 225 n+1.

The synthetic geometry 200 is based on a digital coordinate system 250.That is, the key imagery points, derived from the synthetic geometry,are used for the digital coordinate system data points. The digitalcoordinate system may be the same as a GPS coordinate system or, at aminimum, or may be correlated to a GPS coordinate system (the GPScoordinate system may be simplified to any general, external, widespreadcoordinate system, i.e. an accessible, ubiquitous coordinate system).

The enterprise system 105, then, generates a wireframe model or othersimplified representation of real world objects (i.e. surface models)designed to register digital content with the real world. In thewireframe model, geographic image sources are assigned coordinate pointsto key data set features, i.e., every endpoint of lines of wireframewhere the coordinates are based on GPS location information. Forexample, the edges of a building include distinct coordinate values, asdoes the edges of a street. The enterprise system 105 extracts thesecoordinate values from the image sources to generate a wireframerepresentation of the world. Stated another way, the enterprise system105 creates a simplified geometry of the real world objects (syntheticgeometry) from sources other than the mobile device. The wireframerepresentation, then, is a mathematically efficient geo target set.

Content authoring tools (software development kits or SDKs) may use thissynthetic geometry construct to create and geo-register content, withthe content containing links to the digital coordinate system to controlplacement of the digital data. The layer construct may be used in thesame way that animation software constructs content by first workingwith wireframe geometry and then incrementally adds geometry detailssuch as shading and texturing to minimize processing when generating thecontent. This processing minimization is primarily performed to minimizethe development time from the time required to render the images. Theeffect of using the simplified geometry sets or layers for contentgeneration will be to allow accurate content placement and fasterdevelopment of the content, giving developers the ability to control theaccuracy and duration of their work.

The content authoring tools may be given access to the syntheticgeometry databases via an Application Programming Interface (API) thatenables web based access. The web basis for this is required so that thedatabase is always kept up-to-date and the content developers alwaysaccess the most up-to-date geometry. Content generator web access willalso enable the connections necessary for end user access and tracking.

In this manner, the content authoring tools may be utilized to developdigital content/information utilizing the synthetic geometry 200, whichis then saved on the enterprise system in a layered structure (with dataexisting on one or many layers). This digital data information is thenassociated with the geometry model (e.g., the nominal layer of themodel). Specifically, n+1 data layers may be created. Referring to FIGS.2C-2D, a first digital data layer 255 including content A and contentB1, a second digital data layer 260 including content B2 and content C,a third digital data layer 265, and a fourth digital data layer 270 n+1including content B3 may be provided. As shown in FIG. 2D, the digitaldata—the content A, B1, B2, B3, C—may be selective associated with oneor more of the geometry model layers 210, 220, 225 n+1 230, 240. Thedigital data layers 255, 260, 265, 270 n+1 are essentially filters,being selected and organized via the content authoring tools. Digitaldata layers 255, 260, 265, 270 n+1 may be organized in any number ofways, including by importance, location (nearest item taking priority),temporal based, etc.

In operation, user filters on the mobile device may be used to selectthe predefined digital data layers, or to generate new selection filtersthat cross multiple digital data layers or filter within a layer. All ofthe content includes metadata with the geo-location information, alongwith the nominal layer and grouping information.

The mobile device 115 may include one or more processing devices forexecuting a software application (i.e., software program instructions).In an embodiment, the mobile device 115 includes a mobile telephone suchas a smartphone or a tablet computer. In the embodiment illustrated inFIG. 3, the mobile device 115 is a head-up display in the form ofeyewear including one or more cameras 310 and a display system 320configured to display images on the lenses 330 of the eyewear. Forexample, the display system 320 may be an OLED microdisplay thatprojects an illuminated image toward the lens. In other embodiments, themobile device may also be a mobile phone, tablet, or other portablecomputing device that includes a display.

The mobile device 115 is equipped with one or more of a globalpositioning system (GPS) device, a compass, and an inertial measurementunit (IMU). In addition, the mobile device 115 includes a datatransceiver operable to wirelessly transmit data to (e.g., GPS andcamera image data) and to receive data (digital data) from theenterprise system 105. Additionally, the mobile device 115 may beconfigured to engage in wireless communications such as sending andreceiving telephone calls and/or wireless data in conjunction with textmessages such as emails, short message service (SMS) messages, pages andother data messages that may include multimedia attachments, documents,audio files, video files, images and other graphics. Accordingly, themobile device 115 may include a wireless transceiver for communicatingover a long range wireless network such as a cellular, PCS, CDMA, GPRS,GSM, iDEN or other wireless communications network. Alternatively or inaddition to, the wireless communication may further include atransceiver for communicating over a short-range wireless network suchas an IEEE 802.11 compatible network, a Wimax network, another wirelesslocal area network connection or other communications link. By way ofexample, the mobile device 115 may include a short or medium rangetransceiver operating in conjunction with a communication standard suchBluetooth® or other standard short or medium range communicationprotocol.

The mobile device 115 further includes executable software thatinitiates the data transfer process. The software may be stored on themobile device 115 in the form of a specialized application, or may beexecuted via HTML5. In operation, as shown in the on-device process flow400 provided in FIGS. 4A and 4B, in Steps 405, 410, and 415, the devicesoftware will selectively read the GPS, IMU, and magnetometers (e.g., acompass), and/or other sensors disposed on the mobile device 115. Forexample, the software reads the IMU and magnetometer to determine thelocation and pointing vector of the user, and reads the GPS to determinethe user's location. Alternatively, the mobile device 115 may use othermethods for determining its location such as WLAN (WI-FI) or othertechnologies. When navigating indoors, the system could use WLANinformation to download indoor layouts and use multiple WLAN sources orother RF for image based sources for navigation reference points.

In Step 420, this location information will be sent to the enterprisesystem 105 (i.e. the synthetic geometry server). The enterprise system105 pulls geometry data for the area surrounding the user (Step 425),and then sends back to the user a nominal geometry set (Step 430), whichis received by the mobile device 115 (Step 435). For example, theenterprise system 105 pulls and sends a 2 km diameter wireframerepresentation of the user's geo-location. This query to the enterprisesystem 105 may serve to trigger user tracking initiation.

In the case of a user moving into areas with poor connectivity, the usermay download the synthetic geometry in advance, or the range or area ofthe synthetic geometry may be increased (relevant data for the area mayalso be downloaded for later use). The surrounding geometry and extrainformation including geometry beyond the original set may be saved orcached within the mobile device to improve the load times when the useris moving through different areas. The mobile device may pull this extrainformation based on dynamic bandwidth measurement, i.e., pullinginformation if there is available bandwidth.

An additional method for reducing the downloaded dataset is to use aprefetch function that downloads information based on previous userrequests for a particular area. Based on system expectations of wherethe user is going, i.e., from the destination address, etc. the systemmay download the information for that location in advance.

As noted above, the IMU and magnetometers will set the user's pointingvector (where the user is looking based on the orientation of the mobiledevice 115, i.e. what the screen shows on a mobile phone or imagery fromcameras on a head mounted system). Alternatively, the pointing vectormay be determined from the GPS position of the user and a comparison ofimagery from the camera on the mobile device to imagery databases. Theoriginal query for information may also operate on this pointing vectorto reduce the overall data download requirements, i.e. download asmaller geometry set. The mobile device could select the level of datato download based on dynamic bandwidth measurements. The mobile devicemay start with the data around the pointing vector, and sequentiallyload in the geometry and additional information outside the pointingvector.

The software on the mobile device 115 enters a loop 440, extracting thesynthetic geometry and generating a pre-filter that is a reduced dataset enabling simplified computation on the mobile device (Step 445).This pre-filtering, for example, may entail hidden line removal andperspective setting for wireframe geometry. The resulting pre-filtereddata is used for a geometry correlation engine on the mobile device. Thepre-filtering reduces the size of the data set required for correlationand provides the targets for correlation. The correlation will look atthe synthetic geometry and try to match real world geometry to it, i.e.the edges of buildings as lines of wireframes may be matched to realbuilding edges. The real world geometry used in the correlation engineis extracted from one or more cameras or imagers on the mobile device.

The camera on the mobile device 115 captures frames of video (Step 450)from which the geometry is extracted. The extraction may be accomplishedon each single frame; alternatively, if there is no movement sensed bythe device sensors, the frequency of extraction may be reduced.Algorithms for geometry extraction (e.g., edge extraction, faceextraction, etc.) implemented in code extract the relevant informationfrom geometric objects such as buildings in the imager's field of view(i.e. extraction of the edges from the sides and roof of a building).Additionally, other sensors may provide inputs to the correlationengine, such as the accelerometers to provide the nominal gravityvector. Additional processing routines (FFTs, wavelet transforms, etc.)may additionally be used to help find the desired geometries. Processingroutines may also be used to find predominating orientation vectors suchas verticals and horizontals that will aid in establishing the user'spose (i.e. find the dominate features assuming predominate orientationsof those frequencies). Additionally, more advanced imaging capabilitiessuch as polarimetry may be used to help in determining orientation.

The filtered geometry is overlaid on the video frame and geometrymatching (i.e., overlaid onto edges) is performed (Step 455), with thefiltered geometry data coordinate system then being applied to the videoimage (Step 460). If the location of the pointing vector of the mobiledevice has changed, the process is directed back into the loop 440 (step465), the process determines whether the movement is beyond the range ofthe geometry data set (Step 470) and, if so, reenters the loop 440.

If the location of the pointing vector has not moved out of the range ofthe filter, the process continues into another loop 475, in which thenext video frame being grabbed (Step 480) and the coordinate systemsynchronization maintained by continuous comparison to filteredgeometry, location information, and through electronic imagestabilization techniques (Step 485).

An alternate process flow 500 where the initial matching or subsequentoccasional matching is performed off of the mobile device 115, i.e., atthe enterprise or other similar level, (e.g., cloud based processing) isshown in FIGS. 5A, 5B, and 5C. The offloading of the processing from themobile device onto external resources may be partitioned in any numberof ways in order to optimize on device power consumption, processingbandwidth, transport bandwidth, etc. As illustrated, the mobile device115 determines its location coordinates via, e.g., GPS (Step 501), aswell as reads the device's IMU and/or compass (Step 502). Aftercapturing image frames (Step 503), the device 115 determines itspointing vector (Step 504), and sends this information to the enterprisesystem 105 (Step 505). The enterprise server extracts geometry data forthe area surrounding the user (Step 506), and then performs geometricfiltering (Step 507). The filtered geometry is overlaid onto the videoframe and geometry matching is executed (Step 508), and then supplied tothe video image (Step 509).

At this stage, the enterprise system 105 sends the geometry data to themobile device 115, along with the initial coordinate system matching(Step 510), the data being received by the mobile device (Step 511).Additionally, digital information is sent to (Step 512) and received by(Step 513) the mobile device 115. The mobile device 115 tracks anypointing vector changes from the frames sent to the enterprise serverduring the initial coordinate system matching (Step 514), and thenmatches the coordinate system based on any changes that occurred duringoff-device process (Step 515). The mobile device 115 now displaysdigital data, overlaying it onto the real world view (Step 516). Theprocess continues entering a feedback loop 520 (Steps 521-526), asneeded. That is, to improve system accuracy, a feedback loop may beincluded between the GPS, IMU, and magnetometers. As the GPS isperiodically updated during movement, a path may be correlated to theIMU and magnetometer signals.

At this point, the process may enter another loop 530, with the nextvideo frame being grabbed (Step 531) and the coordinate system beingmaintained as indicated (Step 532).

The user may be given the option of performing a manual overlay of thegeometry onto the real world imagery if the system cannot perform anadequate lock. Other methods of providing a lock may incorporate acalibration process, an example of which may be accomplished through theimage capture of a known object (at a known location). The scaling ofthe object may provide distance, while the edges or other geometryinformation may be used to set orientation of the user. The use ofmultiple objects may further increase accuracy.

Another feedback loop using existing photographic databases may beconstructed. Correlation edges and/or image correlation from known posesand positional data incorporated in metadata associated with 2D imagerymay be used to correlate the user's position and pose.

The use of synthetic geometry may additionally be used for indoorregistration and the setting of way points or otherwise used fornavigation. The edges of walls, doors, pillars, windows, etc. fromarchitectural or design drawings (a form of synthetic geometry) may beused for the edge matching filters on the mobile device. The geometry ofthe building may be downloaded to the mobile device, and the sameprocessing as is done for outdoor geometry may be used to geo-registerthe mobile device, i.e., hidden line removal, perspective setting,geometry correlation, etc. With the geometry of the interior structureknown, distances between features will also be known, so that as thegeometry is correlated, the user's changing position within thestructure may also be correlated, allowing the user to navigate withinthe building.

Additional information regarding the system and its functioning isprovided in the attached appendix.

While the invention has been described in detail and with reference tospecific embodiments thereof, it will be apparent to one skilled in theart that various changes and modifications can be made therein withoutdeparting from the spirit and scope thereof. For example, while a mobiledevice is illustrated, the instructions for performing applicationfunctions may be included in any computer program product configured forexecution by one or more processors.

Thus, it is intended that the present invention cover the modificationsand variations of this invention that come within the scope of theappended claims and their equivalents. It is to be understood that termssuch as “left”, “right” “top”, “bottom”, “front”, “rear”, “side”,“height”, “length”, “width”, “upper”, “lower”, “interior”, “exterior”,“inner”, “outer” and the like as may be used herein, merely describepoints of reference and do not limit the present invention to anyparticular orientation or configuration.

I claim:
 1. A mobile device configured for augmented reality comprising:an image capture device operable to capture an image of a real scene; alocation sensor operable to determine the geographic location of themobile device; an orientation sensor operable to determine theorientation of the mobile device; and a processor operable to: determinea pointing vector directed towards the real scene from the orientationof the mobile device; receive wireframe geometry data over a wirelesscommunication link from an enterprise server storing digital datadefined on a digital coordinate system, the received wireframe geometrydata corresponding to a predetermined area surrounding the geographiclocation of the mobile device; filter the received wireframe geometrydata to a region aligned on the pointing vector, the region beingsmaller than the area surrounding the geographic location of the mobiledevice; and register the filtered geometry data onto the image.
 2. Themobile device of claim 1, wherein the orientation sensor is a sensorsuite including a compass and an inertial measurement unit.
 3. Themobile device of claim 1, wherein the location sensor is a globalpositioning system receiver.
 4. The mobile device of claim 1, furthercomprising a head-up display on which the wireframe geometry data isdisplayed.
 5. The mobile device of claim 1, wherein the processor isconfigured to perform hidden line removal and perspective setting priorto registering the filtered geometry data onto the image.
 6. The mobiledevice of claim 1, wherein the processor is further operable to registerthe wireframe geometry data by matching wireframe features defined onthe digital data coordinates in the received geometry data with edges inthe image captured by the image capture device.
 7. The mobile device ofclaim 1, wherein the processor is further operable to: filter thereceived wireframe geometry data, in response to affirming that thepointing vector is moved outside the filtered geometry data, to anotherregion aligned on a new pointing vector and defined by the extent of anew image captured by the image capture device.
 8. The mobile device ofclaim 1, wherein the processor is further operable to: determine whetherthe pointing vector is moved outside the received wireframe geometrydata; receive other wireframe geometry data from the enterprise serverfor the digital coordinates corresponding to the predetermined areasurrounding the geographic location of the mobile device; and filter thereceived other wireframe geometry data to another region aligned onanother pointing vector.
 9. The mobile device of claim 1, wherein thewireless communication link between the mobile device and the enterpriseserver includes a cellular network wireless communication link.
 10. Themobile device of claim 1, wherein the wireless communication linkbetween the mobile device and the enterprise server includes an IEEE802.11 compliant wireless communication link.
 11. The mobile device ofclaim 1, wherein the enterprise server establishes the region around thelocation of the mobile device as a two (2) kilometer diameter region inthe digital coordinate system.
 12. A method of augmenting a real scenecaptured by a mobile device, the method comprising: determining ageographic location of the mobile device via a location sensor;determining a pointing vector of the mobile device via an orientationsensor; transmitting the geographic location and the pointing vector ofthe mobile device from the mobile device to an enterprise server over awireless communication link established therebetween, the enterpriseserver storing digital data defined on a digital coordinate system andwireframe geometry data representative of the digital data defined onthe digital coordinate system; receiving the wireframe geometry datafrom the enterprise server over the wireless communication link, thereceived wireframe geometry data corresponding to, in the digitalcoordinate system, an area surrounding the geographic location of themobile device; filtering the wireframe geometry data to a region alignedon the pointing vector of the mobile device, the region being smallerthan the area surrounding the geographic location of mobile device;capturing a video frame of the real scene aligned on the pointingvector; and registering the filtered wireframe geometry data onto thecaptured video frame.
 13. The method according to claim 12 furthercomprising: comparing the filtered wireframe geometry data with thedevice location; and receiving updated wireframe geometry data from theenterprise server only upon affirming that the geographic location ofthe mobile device is outside the area surrounding the geographiclocation of the mobile device in the digital coordinate system.
 14. Themethod of claim 12, further comprising: selecting, through a userinterface by a user, digital data from a data source; aligning thedigital data on a user selected location in the digital coordinatesystem; receiving the digital data in the wireframe geometry data overthe wireless communication link; and registering the digital data on theimage.
 15. The method of claim 12, further comprising: filtering thereceived wireframe geometry data, in response to affirming that thepointing vector is moved outside the filtered wireframe geometry data,to another region aligned on another pointing vector.
 16. The method ofclaim 12, further comprising: determining whether the pointing vector ismoved outside the received wireframe geometry data; receiving otherwireframe geometry data from the enterprise server for the digitalcoordinates corresponding to the predetermined area surrounding thegeographic location of the mobile device; and filtering the receivedwireframe geometry data to another region aligned on another pointingvector.
 17. The method of claim 12, further comprising: organizing thewireframe geometry data, at the enterprise server, in accordance withproximity in the area surrounding the geographic location of the mobiledevice in the digital coordinate system to the pointing vector in thedigital coordinate system.
 18. A method of augmenting a real scenecaptured by a mobile device, the method comprising: determining ageographic location of the mobile device via a location sensor;capturing at least one video frame of the real scene and generating acorresponding at least one image from the video frame; determining apointing vector of the mobile device via an orientation sensor;transmitting the image, pointing vector, and the geographic location ofthe mobile device from the mobile device to an enterprise server over awireless communication link established therebetween, the enterpriseserver storing digital data defined on a digital coordinate system andwireframe geometry data representative of the digital data defined onthe digital coordinate system; filtering, at the enterprise server, thewireframe geometry data to a region aligned on the pointing vector atthe geographic location; registering, at the enterprise server, thefiltered wireframe geometry data on the image and determining an initialcoordinate therefrom; transmitting the wireframe geometry data and theinitial coordinate from the enterprise server to the mobile device overthe wireless communication link for all of the at least one image onwhich the filtered wireframe geometry data has been registered; andoverlaying, at the mobile device, the wireframe geometry data receivedfrom the enterprise server onto all of the at least one image using theinitial coordinate.
 19. The method of claim 18, further comprising:capturing a plurality of the video frames of the real scene andgenerating a corresponding plurality of images from the video frames;transmitting the images with the pointing vector and the geographiclocation of the mobile device to the enterprise server; registering, atthe enterprise server, the filtered wireframe data onto the images anddetermining therefrom respective initial coordinates for the images; andoverlaying, at the mobile device, the wireframe geometry data receivedfrom the geometry data onto the images using the respective initialcoordinates.
 20. The method of claim 19, further comprising: organizingthe wireframe geometry data received by the mobile device in accordancewith proximity to the pointing vector of a predetermined one of theimages; determining whether the pointing vector has changed from thereal scene corresponding to the predetermined one of the images; andselecting other wireframe geometry data received by the mobile devicecorresponding to the real scene toward which the changed pointing vectoris directed.